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Abstract. We give an extension to a nonconvex setting of the classical radial 
representation result for lower semicontinuous envelope of a convex function 
on the boundary of its effective domain. We introduce the concept of radial 
uniform upper semicontinuity which plays the role of convexity, and allows to 
prove a radial representation result for nonconvex functions. An application to 
the relaxation of multiple integrals with constraints on the gradient is given. 



1. Introduction 

In convex analysis, a convex and lower semicontinuous function is represented 
on the boundary of its effective domain by a radial limit along segment from an 
interior point. Our goal is to give an extension to a nonconvex setting of this result. 
The motivation comes from the theory of relaxation in the calculus of variations 
with constraints, which consists to the study of the integral representation of the 
lower semicontinuous envelope of integral functionals subjected to constraints on 
the gradient. 

For convex constraints and when the lower semicontinuous envelope is convex, 
the radial representation on the boundary holds and allows, under some additional 
requirements, to extend the integral representation to the whole effective domain 
of the functional (see for instance |CDA02] 1 However, even for convex constraints, 
the lower semicontinuous envelope is not necessarily convex when the gradient is 
a matrix (which is called the vectorial case). Indeed, in this case it is well known 
that if an integral representation holds then, usually, the "relaxed" integrand is 
quasiconvex or rank-one convex (in the sense of Morrey, see for instance |Dac08j ). 
Therefore, the need for a generalization of the radial representation to a nonconvex 
setting comes naturally. The analysis of how the convexity concept play to obtain 
the radial limit representation highlights some kind of uniform upper semicontinuity 
property, more precisely, when / : X — >] — oo, oo] is convex (X is a vector space) 
we may write 

(l.D sup ffl^ffl S l-< 

uedomf 1 + \f{ u 0)\ + \f{u)\ 

for any uq € dom/. The left hand side of (jl.ip is a kind of uniform semicontinuity 
modulus which is lower than when 1 1 L This is exactly the property we need to 
overcome the convex case. For a non necessary convex / satisfying (jl.lj) . we will say 
that / is radially uniformly upper semicontinuity (see Definition [2TTJ). The concept 
of radial uniform upper semicontinuity, to our best of knowledge, finds its origin in 
[CDA021 Condition (10.1.13), p. 213] in connection with relaxation problems with 
constraints. Later, this concept was proved very useful for relaxation problems in 
the vectorial case with bounded and convex constraints see [XH10J. Then, it was 
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used to study several homogenization and relaxation problems with constraints (see 
for instance [AHMllal IXHMllbl IManlll IAHM12] 1. 

The plan of the paper is as follows. In Section [2J we first give the definitions 
of radially uniformly upper semicontinuous functions and star-shaped sets (stated 
here in an infinite dimensional framework) which play the role of convexity concepts 
in a nonconvex setting. 

In Scction[3l we state and prove the main result Theorcm l3.ll which gives a radial 
representation of a lower semicontinuous envelope on the boundary of a star-shaped 
set. A sequential version of Theorem 13. II is stated and proved also. 

In Section 21 we deduce some general consequences from Theorem 13.11 In par- 
ticular, we deal with the case of convex functions and minimization problems with 
star-shaped constraints. 

In Section [5l we study the stability of radially uniformly upper semicontinuity 
concept with respect to calculus operations. We also give examples of some general 
class of radially uniformly upper semicontinuous functions. 

Section [5] is devoted to an application of a relaxation problem of the calculus of 
variations with constraints on the gradient. 

2. Definitions and preliminaries 

Let X be an Hausdorff topological vector space. For a function / : X — >] — oo, oo] 
we denote its effective domain by 

dom/ := {ue X : f(u)<oo}. 

For each a>0, D C dom/ and uo £ D, we define D Uq : [0, 1] —>} — oo, oo] by 

A a (t) ._ f(tu+(l-t)u )-f(u) 

A />D>Uo(f ).-sup o+|/(u)| 
If D = domf then we write A?, := A « n „ . 

Remark 2.1. By analogy with the case of uniform continuity, the function A^ D Ug (•) 
can be seen as a (semi) radial uniform modulus of f on D relatively to uq. 

Definition 2.1. 

(1) Let D C dom/ and uq G D. We say that f is radially uniformly upper 
semicontinuous in D relative to uq, if there exists a>0 such that 

iimA£ Atto (*)<0. 

Radially uniformly upper semicontinuous will be abbreviated to ru-usc in 
what follows. 

If D = dom/ then we simply say that f is ru-usc relative to uq 6 dom/. 

(2) We say that D C X is a (strongly) star-shaped set relative to u € D, if 

W + (l- t)uo C D for all t e [0, 1[, 

where D is the closure of D in X. 

When D C dom/ is star-shaped relative to 6 D and / is ru-usc in D relative 
to Ko £ U, we say that / is ru-usc in the star-shaped set D relative to uq € D. 

Remark 2.2. 

(i) Our definition of star-shaped sets is more restrictive than the usual one (see 
|Val64] ) which requires 

tD+(l- t)u Q C D for all t G [0, 1]. 
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Xd(u) := 



(ii) When X is a normed vector space, a convex set D C X with nonempty 
interior is star-shaped relative to any uq £ int(D), this fact is also known 
as the line segment principle (sec RW98, Theorem 2.33, p. 58]). Moreover 
if D C X is star-shaped relative to all uo £ D then D is convex. An 
example of star-shaped set which is not necessarily convex is given by the 
union of two different convex sets D\ U Z?2 with int(Z?i n D%) 7^ 0, indeed 
if uo £ int(Di n D2) then for each u £ D\ U D2 either u £ D\ or u £ D2, 
so tu+ (1 — t)uo £ D\ or tu + (1 — t)uo £ D2 for all t £ [0, 1[ since Di and 
D2 are convex with nonempty interior and then star-shaped relative to uq. 

Proposition 2.1. Let f : X — >] — 00, 00] be a convex function. Let D C dom/ and 
uq £ D. Then f is ru-usc in D C dom/ relative to uq £ D . 

Proof. By convexity of / it is easy to see that for all t £ [0, 1[ 

A i+I/K)| m _ _ ln /(ta + (l-tH)-/(M) 

1 + l/MI + l/HI " 

which shows, by letting t — > 1, that / is ru-usc in D relative to uo- B 
For each set 13 C X we denote by xd the indicator function of D given by 

if u £ D 
00 if u £ X\D. 

Remark 2.3. If a set D C X is star-shaped relative to uq £ D then xd is ru-usc 
relative to ito- 

We denote by / the lower semicontinuous envelope of / given by 

f{u) = lim f(v) :— sup inf f(v) 

uev(u) v£U 

where V(u) denotes the set of neighborhoods of u £ X. 

The convergence of a sequence {u n } n Cltoii with respect to the topology of 
X is denoted by u n — >u. We denote by / the sequential relaxation of / given by 

f (u) = inf <^ lim f(u n ) : X 3 u n ->U 

Remark 2.4. It is easy to see that / < / and / = /. It is worth to note that / is 
sequentially lower semicontinuous, i.e., for every {«„}„ C X and u £ X if u n — > u 

then lim n _ > , 00 f(u n ) > f(u). We have / < f S < f and in general / S is different 
from / . 

For each uq £ dom/ the radial extension f Uo : X — > [—00,00] relative to uq is 
defined by 

fu (u) := lim/(<M + (1 - t)u ) 

where 

ljm f{tu + (1 - t)u ) = inf j lim f(t n u + (1 - t n )u ) : [0, 1[9 t n -> 1 

tfl Ln— >oo 

Remark 2.5. The effective domain of f Uo satisfies dom/„ C dom/ C dom/, in- 
deed, if we consider u £ dom/ UQ then for some {t n } n £ [0, 1[ such that limn^oa t n = 
1, we have by Remark 12.41 

oo>f Uo (u) = ]xmf(tu+ (1 -t)u ) = lim f(t n u + (l-t n )u Q )>f s (u)>f(u). 

71— t-CXj 

since t n u + (1 — t n )uo — > u as n — > oo. 
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3. Main results 

3.1. Radial representation on the boundary of a star-shaped set. Here is 
the main result of the paper which establishes a radial representation of the lower 
semicontinuous envelope of a ru-usc function penalized by a star-shaped subset. 

Theorem 3.1. Let f : X — >] — oo,oo] be a ru-usc function in a star-shaped set 
D C dom/ relative to uq £ D. Assume that inf^ />— oo, we have 



(i) if f + XD= f on D then f + \D = fu + Xd'> 

(ii) fu (u) = lim f(tu+ (I — t)uo) for all u £ D, and f Uo is ru-usc in Dndom/ Mo . 

tfi 



Remark 3.1. The condition in Theorem 13. II (i) i.e. / + \d = f on D, means that 
/ is lower semicontinuous in D in the sense that lim p^ r >tl f(v) = f(u) for all 
U £ D. Thus Theorem 13. II (i) can be rewritten as 

VueD lim f(v) = f(u) => VuEdD lim f(v) = lim f(tu + (1 - t)u ). 



Proof of Theorem fOI Proof of (i) Fix u £ D. We have (1 - t)u + tu £ D for all 
t £ [0, 1[ since D is star-shaped relative to uo. Hence 

f Uo (u) = lim f(tu + (1 - t)u ) 
tfi 

= lim f (tu + (1 - t)u ) + XD(tu + (1 - t)u ) 
tfi 



> / + Xd(«). 



It remains to prove that / tto + x~n — f + X-D- It is equivalent to show that for 
every 5>0 and every uEflwe have f Uo (u)<5 whenever / + xd(u)<8- 

Fix <5>0 and u £ D such that / + xd(u)<8. Then there exists ?7>0 such that for 
every U £ V(u) it holds 

(3.1) inf '(/ + Xd)(«)= hif /(*;)< J- 2ry. 

w6(7 veUnD 

For each 17 £ V(u) there exists v v £Uf]D (Note that J7 n D ^ for any f7 £ V(u) 
since u £ D.) such that 

(3.2) /M< inf /(<;) + tj< 5- r? 
since (|3.ip . 

Let € [0, 1[ be such that lim^oo i„ = 1, and for every n e N 

(3-3) A^ no (i„)< ' 



n+1 



since / is ru-usc in D relative to uq. 

Fix U £ V(u). By (33) and ((33) we have 



(3.4) /(t^ + (1 - i„)u ) < &l DjU0 (t n ) (a + l/MI) + /(«£/) 



n + 1 

On the other hand, for every n £ N it holds 



f{t n vu + (1 - <n)uo) > inf /(t„u + (1 - t n )u ). 

veunD 
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We have t n u + (1 — t n )uo € D for all n G N since £) is star-shaped relative to ito- 
So, by using p.4p . the assumption / + \d = f on D we obtain for every n G N 

8 -T]> sup inf /(t„u + (1 - t n )u ) 
uev(u) vt ^ UnD 



f + XD(t n u + (1 - t n )u ) 
f(t n u + (1 - f„)u )- 



Letting n — > oo we find that f Uo (u) < 5 — 7/, which completes the Proof of (i) 
Proof of (ii) We first have to prove that for every u G £> 

lim f (iti + (1 - tW) = hm /(iu + (1 - i)u ). 
t-KL- f-*- 1 " 

Fix u £ D. It suffices to prove that 

(3.5) Em*(i) < Um*(t). 

where ^(t) := f(tu + (1 — t)uo) for all t G [0, 1]. Without loss of generality we can 
assume that lim f ^ W(f)<oo. Choose two sequences {£„}„, {s„} n c]0, 1[ such thalQ 
t„ 1, s n 1, I 21 - < 1 for all n G N, and 

iim*(t) = lim *(t„); 

t— »1 n— >oo 

lim^ffl = lim *( s „). 

Since I? is star-shaped relative to Mo we have t n u + (1 — t n )uo G D for all n G N, 
so we can assert that for every n G N 

(3.6) tt(i„) = * ( — s r 



Sr. 



Uq 



= f \ —{s n u + (1 - s n )u ) + ( 1 - — 

<Aj, DtU0 (o+i*( an )i)+*(* B ). 

We have that (|3.5p follows from (I3.6[) by letting n — > oo since / is ru-usc in D 
relative to uq. 

It remains to prove that f Ua is ru-usc in D n dom/ Uo . Fix f G [0, 1[ and u G 
D D dom/ Uo . By the first part of the Proof of (ii) we can assert that 

fu {u) = lim f(su+ (1 - s)u ) 
fu {tu + (1 - t)u ) = lim f(s(tu + (1 - i) u o) + (1 - s)wo)- 

S— >-l 

So, we have 

fu (tu + (1 - t)-» ) - / Mo (u) 
a+\f U0 (u)\ 

f(t(su + (1 - a)u„) + (1 - t)u ) - f(su + (1 - s)«o) 



— lim 

»-n a+|/(stt+(l-s)u )| 



Once the sequences {t„}„, {s n }„ C]0, 1[ satisfying t n — y 1, s n — > 1 choosen, we can extract 
a subsequence (s„(„i}„ such that — ™ — < 1 for all n € N. Indeed, it suffices to consider the 

increasing map a : N — ¥ N defined by cr(0) := min{f € N : s v > to} and <r(n + 1) := miri{V £ N : 
v > <r(n) and s v > 
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It follows that A a — - ft) < A"i n „, (t) and the proof is complete by letting 

Ml. ■ 

3.2. Sequential version of Theorem 13.11 It is well known that if X has a 
countable base of neighborhoods of then / = /. For a subset D C X, we denote 
by D the sequential closure of D, i.e., u G -D if and only if there exists a sequence 
{t) n } n C D such that t>„ — > u as n — > oo. We say that D C X is a sequentially 
star-shaped set relative to uq G Z?, if 

tlf + (1 - f)-ti C D for all t G [0, 1[. 

Here is a sequential version of Theorem 13.11 

Theorem 3.2. Let f : X — >] — oo,oo] &e a ru-usc function in a star-shaped set 
D C dom/ relative to uq (z D . Assume that mijj />— oo, we /iave 



(i) iff + XD = f on D then f + xd = fu„ + Xw >' 

(ii) funiu) — lira f(tu + (1 — f)«o) / or u € ^ > o 716 ' /« * s ru-usc in D s D 
dom/„ . 



Proof. For the sake of completeness we give the proof of (i) although very similar 
to the one of Theorem I3.llti) 



Fix u G D . Let {t n } n C [0, 1[ such that limn^oo t n = 1 and 
f UQ {u) = lim f{t n u + (1 - t„)uo)- 

n— >oc 

We have (1 — t n )uo + t n u G D for all n G N since Z? is star-shaped relative to uq. 
Hence 

/u (u) = lim f{t n u + (1 - *n)uo) 

n— »oc 

= lim /(t„u + (1 - t n )u Q ) + XD{t n u + (1 - t n )u ) 



>.f + XD (U) 

since t n u + (1 — t n )uo — > u as n — > oo. 



It remains to prove that / Uo + x^j» < / + Xr> • Fi x <^>0 an d w G D such that 



/ + Xd (u)<5. So we can find n G]0, <5[ and a sequence {u„}„ G I? such that 
v n — y u and lim f(v n ) < S — n. 

n— >oo 

Choose a subsequence C D (not relabelled) such that 

(3.7) v n — > u and |/(w n )| < max |— inf /, 5 — 77 1 for all n G N. 
Let {tfcjfc G [0, 1[ such that lim / ! £ _ ! . 00 tk — 1, and for every neN 

(3.8) A£W**)< ' 



1 



since / is ru-usc in D relative to uq. So, by (|3.7I) and (I3.8[) . for every fc, n G N we 
have 

(3.9) f(t k v n + (1 - t fc )uo) < A£ DiUo (t fc ) (a + |/(v„)|) +/(«») 

< - — ^ + max | — inf /, 5 — rj|^ + 5 — rj. 
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We have t^u + (1 — tk)uo € D for all k G N since D is star-shaped relative to Uq. 
Letting n — » oo in Q3.9p and using the assumption / + \d = f on D we obtain for 
every fc € N 



/(ifclt + (1 - tk)u ) = f + XD(tkU + (1 - t k )u ) 



< 



(a + max | — inf /, S — rj^^j + S — r\ 



Letting k — > oo we find that f Uo (it) < S — rj, which completes the Proof of (i) 



The proof of (ii) is the same as the proof of Theorem I3.1|(ii) 



4. General consequences 

4.1. Radial representation with the effective domain as constraint. When 
D = dom/ we have the following result. 

Corollary 4.1. Let f : X — >] — oo, oo] be a function such that f is ru-usc in the 
star-shaped set dom/ relative to uq G dom/. // g : X — >] — oo, oo] is such that f = g 
on dom/ then 

f = Qua + Xdom/ 



where g Uo (u) — lim^i g(tu + (1 — t)uo) for all u G dom/. 

Proof. Since / = g on dom/ and dom/ is star-shaped relative to uq G dom/ the 



function g is ru-usc in dom/ relative to uq. Thus applying Theorem 13.11 (ii) 
obtain for every u G dom/ 

?«o( u ) = lim + (1 - *)"o)- 
Now, we have to prove that / = g u „ + X dom j- It is easy to see that 

f < f + Xdom/ < / + Xdom/ 



WO 



hence / + Xdom/ = / since / + Xdom/ = / and / = /. Apply Theorem [XT] (i) with 



/ in place of / and D = dom/, we obtain / + Xdom/ = / = f Uo + Xd^mJ- Taking 
account of Remark 12.51 we deduce that 

f f Uq Xdom/" 

It remains to prove that f u = g U[) on dom/. Fix u G dom/, then tu + (1 — i)ito G 
dom/ for all t G [0, 1[ since dom/ is star-shaped relative to uq. It follows that 

fu ( u ) = ]mf( tu + (1 - £)wo) = lim3(<M + (1 - t)u ) = g Uo (u) 
tfi tfi 

since / = g on dom/, which completes the proof. I 

Remark 4.1. The previous result can be useful in relaxation problems, indeed, in 
practice we are able to prove an integral representation of /, say g, on dom/ only. 
Then we can use Corollary 14.11 to have a representation on dom/. To obtain a 
full integral representation on dom/, we have then to commute "lim^i" with the 
integration in the radial limit g Uo (see for instance Theorem 16. ID . 

Analysis similar to that in the proof of Corollar y |4 . 1 1 gives the following sequential 
version. 



8 



OMAR ANZA HAFSA AND JEAN-PHILIPPE MANDALLENA 



Corollary 4.2. Let f : X — >] — oo, oo] be a function such that f is ru-usc in the 
star-shaped set dom/ relative to uo € dornf. If g : X — >] — 00,00] is such that 
f = g s = g on dom/ then 

f = 9u + XdomJ" 

where g MQ (u) = lim t -[-i g(tu + (1 — t)uo) for all u £ dom/ . 

In the following, we state a consequence of Corollary 14.11 and Corollary 14.21 in 
the particular case where g is replaced by /. 

Corollary 4.3. Let f : X — >] — 00,00] be a function such that f (resp. f ) is 
ru-usc in the star-shaped set dom/ relative to uq <E dom/. If f — f (resp. f = f) 
on dom/ then 

7 = fu {resp. J" = f U0 ). 
Proof. Apply Corollary 14.11 (resp. Corollary 14.21) with / in place of g, we obtain 

7 = /uo + XdomJ ( reS P- 7 S = fuo + XdomJ')- T ° nnish the P r0of [t s U mces to sce 

that dom/ Uo C dom/ C dom/ since Remark 12.51 ■ 

We examine the case / convex. 

Corollary 4.4. Let f : X — >] — 00, 00] be a convex function. If there exists uq G X 
such that f is bounded above in a neighborhood of uq then 



(4.1) f = fu - 

Moerover f Uo = f v for all v £ int(dom/) (where int(dom/) is the interior o/dom/ ). 

Proof. The assumption implies that / is continuous on int(dom/) the interior of 
dom/. So, / + Xi n t(dom/) = / on int(dom/). By Proposition l2.il a convex function 
is ru-usc in int(dom/) relative to all v € int(dom/). It is well known that int(dom/) 
is convex, then by Remark 12.21 (ii) the set int(dom/) is star-shaped relative to all 
v G int(dom/). By applying Theorem l3.1l we find / = /„ +X - mt ^ om fy O n the other 

hand it holds that dom/ C dom/ = int(dom/) since dom/ is convex. Therefore 
(14.11) holds since Remark [231 ■ 



Remark 4.2. When X has finite dimension, more general results involving convexity 
exists, see for instance |Roc70j Theorem 7.5 p. 57, Theorem 10.3 p. 85]. Indeed, 
in finite dimension, the relative interior of dom/ is not empty whenever dom/ 7^ 
and / is continuous on it, so (|4.1[) holds without any assumption on / unless to be 
convex. 

4.2. Minimization with star-shaped constraints. The following result deals 
with minimization problems with star-shaped constraints, it can be seen as a non- 
convex version of |FL071 Corollary 4.41, p. 272]. 

Corollary 4.5. Let f : X — >■] — 00, 00] be a function. Let D C dom/ be a star- 
shaped set relative to uq S D such that D C dom/. Assume that f : X — >] — 00, 00] 
is ru-usc in D relative to uq. If f + xd = / on D then 

inf f = inf f . 

O D 

Proof. It is sufficient to show that inf jj f < inf^-/. By applying Theorem 13.11 we 
have 



(4.2) inf/ = inf/ + X 23=inf/«o- 

D X D 
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Now we claim that for every u E D we have f Uo (u) < /( M )> indeed, 

f U0 (u) =lim/(t« + (1 - t)« ) < SA' B (t)(a + + f(u) < f(u) 

since / is ru-usc in D relative to uq . We deduce from (|4.2|) that inf d / < inf-jj /, 
and the proof is complete. I 

In scalar problems of the calculus of variations the lower semicontinuous envelope 
/ of a nonconvex / is convex, so the following result can be useful in this regard. 

Corollary 4.6. Let f : X — >] — oo, oo] be such that f is convex. Let D C dom/ be 
a star-shaped set relative to uq E D such that D C dom/. TTien 



inf f = inf f . 



Proof. We have 



f<f + XD<f + XD. 



Thus f + xd = f on D. By Proposition 12.11 f is ru-usc in D C dom/ relative 
to any uo € -D, so we can apply Corollary 14.51 with / in place of /. The proof is 
complete. ■ 

5. Operations on ru-usc functions 

In this Section we study the stability of ru-usc functions with respect to some 
operations. We also give some examples of class of ru-usc functions. 

5.1. Stability of ru-usc functions with respect to pointwise sum and prod- 
uct. We need the following result in the proof of Proposition 15. II 



Lemma 5.1. Let f : X — >] — oo, oo] be a ru-usc function in D C dom/ relative to 
Uq € D. Then 

(i) f + c is ru-usc in D relative to uq for all c 6 K; 



(ii) A/ is ru-usc in D relative to uq for all A G 



Proof. Proof of (i) Fix u e D and c E M. Fix e>0. There exists t E e]0, 1[ such 
that sup te i 4e)1 [ D Uo (t)<e since / is ru-usc in D relative to uq. 

We set f c '-=f+ c. Then for every t E]t E , t[ we have 
(5.1) f c (tu + (1 - t)u ) - f c {u) = f(tu + (1 - t)u ) - f(u) 

<Al DtU0 (t)(a + \f(u)\) 
<e(a+\f c (u)\ + \c\). 

It follows that Urut-^i A^ + ^' mq (t) < e. The proof of (i) is complete by letting e — >• 0. 



Proof of (ii) . Fix u E D and A S R + . Fix e>0. There exists t e e]0, 1[ such that 
sup tg ] (e l [ D Uo (t)<s since / is ru-usc in D relative to u . 
We set f\ := A/, then for every t E]t e ,t[ we have 

fx (tu + (1 - t)uo) - fx(u) = A (f(tu + (1 - t)uo) - f(u)) 

<Al DtU0 (t)(Xa+\f x (u)\) 
<emax{Aa,l}(l + |/ A (u)|). 



It follows that lim t _j.i A^ D UQ (t) < emax{Aa, 1}. The proof of (ii) is complete by 
letting e -» 0. ■ 

The stability for the operations sum and product (pointwise) of ru-usc functions 
is specified below. 
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Proposition 5.1. Let f,g:X — >] — oo, oo] be two ru-usc functions in D C dom/n 
doing relative to uq G D . 

(i) If inijj />— oo and inf^ g>— oo £/ien f + g is ru-usc in D relative to uq; 

(ii) If inijj />0 and inf^ g>0 £/ien /g is ru-usc in D relative to uq. 



Proof. Proof of (i) Assume first that / > and g > on D. Fix e>0. There exists 
t £ e]0,l[ such that snp te]UA [A a fDuo (t)<e (resp. sup te]te)1[ A£ Auo (t)<e) since / 
(resp. g) is ru-usc in D relative to uq- Fix t G]t e , 1[ and u E D. We have 

(5.2) /(to + (1 - t)uo) < £ (a + f(u)) + /(«) 

(5.3) <?(to + (1 - t)« ) < e (6 + fl (u)) + <?(u), 
so by adding (15 .2[) with (15 .3|) we obtain 

f(tu + (1 - t)uo) + g{tu + (1 - i)«o) < + /(«) + + /(«) + 

where (5(e) := emaxja + b, 1} and satisfies lim e _>o (5(e) — 0. Therefore 

|imA} +SiDi „ o (t)<(5( £ ) 

which gives the result by letting e — > 0. 

Now, we remove the restrictions made on / and g and we set m := infu /+inf d 9- 
We denote by /+ := / — infu / and g + := <?— inf^ 5. By Lemma l5.f|[i)| the functions 
/ + and g + are ru-usc in D relative to uq, so by applying the first part of the Proof 
of (i) the function / + + g + is ru-usc in D relative to uq. But / + + g + + m = f + g, 



so again by applying Lemma 15.11 we find that / + g is ru-usc in D relative to uq. 



Proof of (ii) By taking the product of (|5.2I) with (15.31) we obtain 
(5.4) 

f(tu + (1 - t)u )g(tu + (1 - t)«o) < <5(e)(l + /(«) + fl (u) + / (u)ff(u)) + /(t*)$(u) 
where (5(e) := max {e, e 2 } max{a&, 2a, 2b, 3} and satisfies lim e _>o 6(e) = 0. But 

(5-5) f{u) + g{u) < f(u)g(u) ( — — + — L_ 

\mi D f mi D g 

From (|5.4j) and (|5.5[) we deduce that 
/(to + (1 - t)«o)s(tu + (1 - *)«o) <S(e) (l + — — + r-j—) (1 + f{u)g(u)) 

+ f( u )g( u ), 

so EEt-n A} 9ir)i „ o (t) < (5(e) + + tj^J which gives the result by letting 

e ->■ 0. 



Remark 5.1. The Proposition 15. II (ii) answers to the question whether class of ru- 
usc functions contains more than convex functions, indeed it is sufficient to consider 
two finite positive convex functions such that their pointwise product is not convex. 

Example 5.1. Assume that X is a normed space. Let g : X — > K be a function 
satisfying: 

(Ai) there exist a > and a function S : [0, 1] — > ffi. satisfying lim t ^i S(t) < 
such that for every t G]0, 1[ and every u G X 

\g(tu + (1 - t)u ) - g{u)\ < 6(t)(l + \\u\\ a + \\u \\ a ); 

(A2) there exist c>0, cf > 0, and (3 > a such that for every u G X 

c\\uf - c' < g(u); 
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then g is ru-usc in D relative to uq. Indeed, by (A2) we have \\u\\ a < \\u\\° + 1 < 
- (g(u) + d) + 1. Set a := c! + c(2 + ||ito|| a ) then it is easy to deduce from (Ai) that 
for every u G D and every t £ [0, 1[ 

g(tu + (1 - t)u ) - g{u) < (a + g(u)) . 

c 

Therefore A® D Uo (t) < which shows, by letting t — > 1, that g is ru-usc in D 
relative to uq. Note also that mfx g>—oo. 

Corollary 5.1. Assume that X is a normed vector space. Let f : X — >] — 00,00] 

be a ru-usc function in D C dom/ relative to uq G D. If info / > — 00 and if 
g : X — >] — 00, 00] satisfies (Ai) and (A2) then f + g is ru-usc in D relative to uq. 



Remark 5.2. Corollary 15.11 can be seen as stability of ru-usc functions with respect 
to a type of "radial Holder" perturbation. 



The following result is an alternative to the Proposition 15 . l|(i) | 

Proposition 5.2. Let f,g:X — >] — 00, 00] be two ru-usc functions in D C dom/n 
doing relative to uq G D. If g is bounded on D, i.e., sup ug£) |g(u)|<oo then f + g 
is ru-usc in D relative to uq. 

Proof. Fix £>0. There exists t e G]0,1[ such that sup te u ^ D Uo (t) <£ (resp. 
sup te ij e l r A b g D Uo (t)<e) since / (resp. g) is ru-usc in D relative to uq- Fix t €]t s , 1[ 
and u G D. We have 

(5.6) f(tu + (1 - t)u ) <e(a+ \f(u)\) + /(«) 

(5.7) g(tu + (1 - t)u ) <e(b+ \g(u)\) + g(u), 
so by adding (15.61) with (I5.7[) we obtain 

/(to + (1 - t)it ) + ff(iu + (1 - t)u a ) 
<S(e)(l + \f(u)\ + \g(u)\) + f(u)+g(u) 
< 5(e)(l + \f(u) + g(u)\ + 2 sup \g(u)\) + f{u) + g{u) 

uG-D 



< 5{e) max 1, 2 sup \g(u)\ \ (1 + \f(u) + g(u)\) + /(«) + ff (u) 
where (5(e) := emax{a + b, 1}, and satisfies lim^o 8(e) = 0. Then 

lim A) +g D uo (t) < 5(e) max 1 1,2 sup \g(u)\ 
which gives the result by letting e 0. 



Example 5.2. Assume that X is a normed vector space. Let D C X be a compact 
and star-shaped set relative to uq G D . Let g : X — >] — 00, 00] be a function which 
is continuous and finite on D. Then g is ru-usc in D relative to Uq. Indeed, let 
lu : [0, oo[— > K be defined by 

uj(S) = s\xp{\g(u) — g(v)\ : u,v G D and \\u — w||<<5}. 

We have \im.$^,.QUj(8) = since g is continuous and D is compact. We have for 
every u G D and every t G [0, 1[ 



g(tu + (1 - t)u ) - g(u) < w (1 - t) sup \\u - u \ 

\ u£D 

Therefore we have A* D UQ (t) < u) ((1 — t) s\xp ueD \\u — uq\\) for all t G [0, 1[. Pass- 
ing to the limit t — > 1 we obtain that g is ru-usc in D relative to uq. 
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By using Example 15.21 and Proposition 15.21 we establish, in the following result, 
that the class of ru-usc functions are stable with respect to a continuous perturba- 
tion when D is star-shaped and compact. 

Corollary 5.2. Assume that X is a normed vector space and D C X is a compact 
and star-shaped set relative to «o € D. Let f : X — >] — oo, oo] be a ru-usc function 
in D C dom/ relative to uq. If g : X — » R is a continuous function then f + g is 
ru-usc in D relative to uq. 

5.2. Inf-convolution of ru-usc functions. For two functions f,g:X — >] — oo, oo] 
their inf-convolution is the function fVg : X — > [— oo, oo] defined by 



(fVg)(u) := inf {f( u -v)+g(v)}. 



The following result establishes the conditions to keep the ru-usc property by the 
inf-convolution operation. 

Proposition 5.3. Let f : X — y]— oo, oo] be a ru-usc function relative to uq £ dom/. 
Let g : X — oo, oo] be a ru-usc function relative to G domg. Then fVg is ru-usc 
relative to uq if one of the following conditions holds: 

(i) infx />— oo and mix g>—oo; 

(ii) sup \g{v)\<oo. 



Proof. Proof of (i) . Assume first that / > and g > 0. Fix u € dom/Vg. Choose 
{v n }n C doing such that f(u — v n ) +g(v n ) —> (fVg) (u) as n —> oo. Fix e>0. There 
exists t £ g]0, 1[ such that sup te ] te l j ^/,£) lUo 

(t)<e ( resp. sup te ] ts l [- t\ g D Uo (t)<e) 
since / (resp. g) is ru-usc in D relative to uq. Fix t E]t e , 1[. We have for every 
n € N 



(5.8) (fVg) (tu + (1 - t)u ) < f(t(u - v n ) + (1 - t)u ) + g(tv n ) 

< e(a + f(u + v n )) + s{b + g(v n )) 



+ f(u - V n ) + g(v n ) 

<6(e){l + f(u-v n )+g(v n )) 
+ f(u-v n ) +g(v n ). 



where 5(e) := emax{l,a + b} and satisfies lim e ^o<^(e) < 0. Letting n — > oo in 
(|5.8p we obtain lim t ^i Aj Vg UQ (t) < 5(e) which gives, by letting e — > 0, that /Vp 
is ru-usc relative to uq. 

We remove the restrictions on / and g. Set / + := f—mfx f and g + := g— irrfx /. 
By Lemma 15.11 the function / + (resp. g + ) is ru-usc relative to uo (resp. relative 
to 0), so we apply the first part of the proof to have f + Vg + is ru-usc relative to 
uo. But f + Vg + + (inf x f + infx g) = f S7g, so again by Lemma UTTI we deduce that 
fVg is ru-usc relative to uq. 
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Proof of (ii) Choose {v n } n C dom<? such that f(u — v n ) + g(v n ) 
n — > oo. Fix t E]t e ,l[. Then for every n € N 

(5.9) (/Vg) {tu + (1 - t)uo) < /(t(u - v n ) + (1 - t)u ) + g(tv n ) 

< e(a + \f{u - v n )\) + e(b + \g(v n )\) 

+ f(u-v n ) +g(v n ) 

<6(e)(l + \f(u-v n )\ + \g(v n )\) 

+ f(u-v n ) +g(v n ) 



{fVg) (u) as 



<5(e)[l + \f(u-v n )+g(v n )\+2 sup \g(v)\ \ 
+ f(u-v n ) +g(v n ) 

where S(t) := e max{l, a + b} and satisfies lim e _ ! .o S(e) = 0. Letting n — ¥ oo in (|5.9[) 
we obtain lim^i A} Vff)U() (i) < 5(e) (l + 2sup t , edoms \g{v)\) which gives, by letting 
e — > 0, that /Vg 1 is ru-usc relative to uo. I 

If g = xc w hh C C X a. star-shaped set relative to G C, then g is ru-usc 
relative to since Remark 12.31 By noticing that sup v£domg \g(v)\ — 0<oo, we 
may apply Proposition 15.31 (ii) to obtain that the function X 3 u H> (fVxc) ( u ) = 
inf„ e c f [u — v) when / is ru-usc relative to uq G dom/. 

Corollary 5.3. Let f : X — >] — oo, oo] be a ru-usc function relative to uq £ dom/. 
Let C C X be a star-shaped set relative to € C. Then /V%c *s ru-usc relative to 
u . 

6. Application to the relaxation with constraints 

Let d, m > 1 be two integers and p €]1, oof. Let 51 C K d be a bounded open set 
with Lipschitz boundary. We denote by M mxd the space of m rows and d columns 
matrices. 

6.1. Star-shaped subsets in W 1 ' p (fl;M rn ). We consider the class of subsets 
S C M rnxd satisfying 
(Hi) OeS; 

(H 2 ) for every sequence {u n } n C W 1,p (n;M m ) such that u„ u in ^^(O; M m ), 
if for every n £ N we have V«„(-) € 5 a.c. in 57 then for every t £ [0, 1[ it 
holds fVtt(-) € S 1 a.e. in f2. 
Define D C ^^(fijR' 7 ') by 

fl:= {«£ W 1 ' p (fi;R m ) : Vu(i) e 5 a.e. in 57} . 

We say that is sequentially weakly star-shaped relative to in W 1,p (£l; R" 1 ) when 
W 1,p (f2;R m ) is endowed with the weak topology and D is sequentially star-shaped 
relative to 0. We denote the sequential weak closure of D in M /1,p (51; R m ) by D . 



The following result shows that the conditions (Hi) and (H2) on S give rise to 
sequentially star-shaped sets of the form D. 



Lemma 6.1. If S satisfies (Hi) and (H2) then D is sequentially star-shaped relative 
to 0. 



Proof. For every t € [0, 1[ and every u £ D we have tu £ D since (H2) 



Example 6.1. It is not difficult to see that if S is convex with £ int^) then S 
satisfies (Hi) and (H2) Indeed, using Mazur lemma we have Vu(-) £ S a.e. in 



57. Then for every t £ [0,1[ it holds tVu(-) £ S a.e. in 57 since S is convex and 
£ vat(S). 
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We give an example of a family of nonconvex sets satisfying (Hi) and (H2 
Example 6.2. Assume that m = d = 2. For each e>0 consider the set 



S £ 

We have for every e>0 



it2x2 



det(£)>tr(£) 2 } 



(i) £ S £ ( i.e. (Hi) is satisfied); 



(ii) for every £ £ S £ we have t£ £ S e for all t £ [0, 1[; 

(iii) S s is not convex; 

(iv) S e is not bounded; 

(v) S e is rank-one convex. 



Fix £>0. The set S e satisfies pb)] for all p>2. Indeed, let {u n } n C W 1 * {Q,;R m ) 
be such that u n — u in W 1,p (fl;R m ) and for every n £ N it holds Vw n (-) £ 5 e a.e. 
in f2. 5?/ a classical result (see |Dac08[ Theorem 8.20, p. 395}) we have 

(6.1) det(Vu„(-)) -» det(Vu(-)) m L% (O; M m ). 

TTie function tr(-) 2 is convex and continuous, so for every borel set A C we have 

2) j : > > ^ iv/U,, / ..'ii-,/,. , / t>-/V7,w' ..11-. 

Using (16. ip and 
£ + 



1 



lim / tr(Vw n (:r)) 2 d:E > / tr(Vu(x)) 2 dx. 

we find for almost all x £ fl and p>0 

1 



l-BpWl ys p (x) \Bp{x)\ J Bp(x) 



then by passing to the limit p — ¥ we obtain Vit(-) £ S £ a.e. in Q. By (ii) we have 
tVu(-) £ S £ a.e. in SI for all t £ [0, 1[. 



The properties (i) and (iv) are immediate 



Proof o/| (ii) I Lett £ [0, 1[ and £ e 5 e . We /lane 

det(i£) = t 2 det(£) > t 2 (tr(£) 2 ) - t 2 e>tr(t£) 2 - e. 



Proof of (iii) Consider 





and £ 



If is easy io see i/ia£ £, £ € 5 e and |£ + i£ ^ S e . 

Proof of (v) VFe /iaue £0 s/iow t/iaf ££ + (! — t)£ £ S e for all t £]0, 1[ whenever 



£, C € S'j satisfy rk(£ — £) < 1. Property (v) follows by using the fact that det(-) is 



quasiaffine (see |Dac08l Example 5.21(i), p. 179}) and tr(-) 2 is convex 

6.2. Relaxation of multiple integrals with star-shaped constraints. Let 

L : M mxd —> [0, 00 [ be a quasiconvex (in the sense of Morrey) integrand with 
p-polynomial growth, i.e., L satisfies 



(Hi) L(0=m\ [ 

[J]o,i[ d 

T&mmxd. 



L(£ + Vu(x))dx : u£ Wo°°{}0,l[ d ;R m ) } for all £ G 



(R' 2 ) There exist c, C*>0 such that c|£| p < L(£) < C*(l + |£| p ) for all £ e M mxd . 
Define the integral functional F : W^ p (Cl; R m ) -> [0, 00] by 



F(u) := 



{J L(Vu(x))dx if Vu(x) £ S a.e. in fl 
00 otherwise. 
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Our goal here is to give a representation of the lower semicontinuous envelope F in 
W^ityW 1 ) endowed with the strong topology of L p {fl;R m ): 

F(u) := inf ( lim F(u n ) : TU 1 '^; R m ) 3 u„ K u\ . 
If J : W^ p (il; W n ) [0, oo] is dehned by 

J(u) := / L(Vu(x))dx. 



then for every u G W 1 ' p (fi;K m ) 

F(u) = J(u)+ X d(u). 



Lemma 6.2. If L satisfies (H^) and (H 2 ) then J is ru-usc in D relative to 



Proof. Since L satisfies (Hj) and (H' 2 ) we have for some C">0 

(6.3) mo - l(o\ < c% - ci(i + ier 1 + icr 1 ) 

for all (,( e M" ix<i (see for instance |Dac08[ Proposition 2.32, p. 51]). For every 
u E D and every t € [0, 1[ 

\J(tu) - J(u)\ < f 2C'(l-t)\Vu(x)\(l + \Vu(x)\ p - 1 )dx 



<4C'(l-t) / l + \Vu(x)\ p dx 

<AC'(l-t) I l + -L(Vu(x))dx 
Jn c 

< 4C" max (l, - I (1 - + J(u)). 



Then A^ D Q (t) < AC max {l, i} (1 — t), the proof is complete by letting t 1. 



Theorem 6.1. if 5 satisfies [(Hi) and (H2) and i/L satisfies (H^) and (H^J £fte 
/or every it G W llP (fi; M m ) 



(6.4) 



F(«) = J(«)+xb-(«). 



Proof. The sequential relaxation of $ : W lp (£l; W n ) — » [0,oo] with respect to the 
weak convergence in W 1,p (fl; M. m ) is given by 

$ sw (u) :=inf ( lim $(«„) : W^(ft;R m ) 9 u„ 



Note that F — F since the coercivity condition (H' 2 ) So, it suffices to show that 



F sw (u) = J(u)+X5-(«). 



We have J = J since (H^) and (H 2 ) (see for instance [AF84J. Then it holds 



J + = J on D, indeed we have 



J=J <J + XZ5 <J + XD- 

Using Lemma 16.21 and Lemma 16.11 we obtain by Theorem 13.11 

F sw — Jo + Xw w w ith Jo(u) — lim J(tu). 



It remains to prove that Jq = J on D \D since F = J + \d = J on D. Fix 



u G -D \D. Using the polynomial growth (H 2 ) we have for almost all x G 



sup L(tVu{x)) < (7(1 + ||Vm(cc)|| p ). 
te[o,i[ 
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The integrand L is continuous since (|6.3[) . We may apply the dominated conver- 
gence theorem to obtain 

Jo(u) = lim J(tu) — / lim L(tVu(x))dx — J(u). 
*ti Jq tfi 

The proof is complete. ■ 
Remark 6.1. The equality (|6.4p . which can be rewritten as 
(6.5) J + Xd = J + Xd" w > 

looks natural since J is of "p-polynomial growth" (and lsc with respect to the strong 
topology in L p (f2;R" 1 )) and since the star-shaped property (of the constraints) can 
be seen as a kind of "regularity" on the constraints. An interesting further extension 
is to study whether similar equality holds when we replace the lsc envelope by 
a F-limit procedure and J by a sequence of funtionals { </„}„ (for an interesting 
discussion about constrained problems see [DG791 p. 499]). 
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